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Stable  Adaptive  Controller  Design 
Part  II:  Proof  of  Stability 


Kumpati  S.  Narendra,  Yuan-Hao  Lin  and  Lena  S.  Valavani 

N 

1.  Introduction:  In  this  paper  w^presenti^a  proof  of  the  stability  in  the  large 
of  an  adaptive  system  which  is  a modification  of  that  originally  suggested  by 
Monopoli  fif and  later  refined  by  Narendra  and  Valavani  The  proof  of  stability 


applies  to  both  continuous  and  discrete  systems. 

^^-In  the  stability  problem  was  clearly  defined  and  a conjecture  was  made  that 


the  plant  together  with  the  controller  would  be  stable  if  the  augmented  error  is 
bounded.  Recently,  while  applying  the  same  approach  to  discrete  systems^  Lin  and 
Narendra  [3]  suggested^*  a new  error  model  based  on..j;h6L^third  prototype^  discussed  in 


[2]  (Lemma  1)  and  on  the  earlier  work  of  Kudva  and  Narendra  [4].  This  model  contains 


an  additional  feedback  term  similar  to  that  found  in  much  of  the  adaptive  observer 
literature  (i^^and  is  particularly  useful  in  proving  the  stability  in  the  large 
of  discrete  adaptive  systems  The  successful  resolution  of  the  latter  problem 

provides  the  motivation  for  using  a similar  model  in  the  continuous  case  as  well . ^ 
Ever  since  the  publication  of  [1]  there  has  been  a great  deal  of  interest  in 
the  problem  of  designing  stable  adaptive  controllers.  In  [8]  Feuer  and  Morse  pre- 
sented such  a controller  but  its  extreme  complexity  precludes  its  use  in  practical 
applications.  Since  then,  several  authors  [9-13]  have  also  attempted  this  problem 
for  both  discrete  and  continuous  systems  but  their  results  are  yet  to  be  verified. 

In  [9]  the  stability  in  the  large  of  a simple  discrete  adaptive  controller  is  con- 
sidered and  both  discrete  and  continuous  controllers  are  discussed  in  [10].  In 
[11]  and  [12]  the  continuous  adaptive  problem  is  treated  when  the  input  to  the 
system  is  "sufficiently  rich".  A proof  of  stability  for  the  continuous  case  is 
proposed  in  [13]  for  the  adaptive  control  problem  considered  in  [1]  and  [2]  and  also 
involves  the  additional  feedback  signal  described  earlier. 
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The  problem  discussed  in  this  paper  is  essentially  the  same  as  that  in  [2]. 

The  philosophy  as  well  as  the  specific  structure  of  the  controller  (except  for 
the  additional  feedback  term)  and  the  adaptive  laws  are  the  same  as  in  [2]. 

Hence,  these  aspects  of  the  problem  are  discussed  in  section  2 only  in  a con- 
densed form  and  the  reader  is  referred  to  [2]  for  all  details.  The  remaining 
sections  are  devoted  to  the  proof  of  stability  with  which  this  paper  is  primarily 
concerned.  The  simple  proof  given  in  section  5 can  be  used,  as  mentioned  earlier, 
for  both  continuous  as  well  as  discrete  systems  with  only  minor  modifications. 

Hence,  even  though  the  emphasis  is  on  the  continuous  case,  comments  are  made  in 
the  paper  to  indicate  how  the  proof  could  also  be  applied  to  the  discrete  case. 

The  augmented  input  to  the  reference  model  was  first  introduced  in  [1]  in  order 

to  avoid  differentiation.  The  concept  of  positive  realness  which  is  central  to  the 

development  of  stable  adaptive  laws  led  to  the  introduction  of  the  operator* 

P (6)  = L(s)0(t)L  1(s)  in  [2].  Much  of  the  difficulty  encountered  in  proving  the 
la 

stability  of  the  adaptive  system  can  be  traced  to  the  characteristics  of  C 0 ) and 

the  related  operator  PT  (0)  ■ L \s)6 (t)L(s)  . Since  P (0)  = PT  (0)  = 0,  when  0 is 
a constant,  it  was  felt  that  the  adaptive  controller  would  be  stable  if  0(t)  changes 
"slowly"  with  time.  This  intuitive  assumption  can  now  be  justified  by  the  stability 
analysis  presented  in  this  paper. 

In  section  2 the  structure  of  the  adaptive  controller  is  discussed  briefly  and 
the  principal  stability  question  is  restated  in  section  3.  While  state-variable 
equations  are  used  wherever  appropriate, the  emphasis  throughout  the  paper  is  on 
input-output  descriptions.  Section  4 is  essentially  self  contained  and  all  the 


mathematical  concepts  needed  are  developed  here.  Using  these  results  the  proof  of 

the  stability  of  the  adaptive  system  is  shown  to  follow  directly  in  section  5. 

* Throughout  the  paper  both  differentia],  equations  and  transfer  functions  »fe 
used  in  the  arguments  and,  depending  on  the  context,  "s"  is  used  as  a y' , 
differential  operator  or  the  Laplace  transform  variable.  y*.  •£ 
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2.  Design  of  the  Adaptive  Controller: 

A plant  P to  be  controlled  is  completely  represented  by  the  input-output  pair 
(u(t),yp(t)}  and  can  be  modeled  by  a linear  time-invariant  system 

x = A x (t)  + b u(t) 

P P P P (!) 

y = h x (t) 

*P  P P 

where  A is  an  (nxn)  matrix  and  h and  b are  n-vectors.  The  transfer  function  of  the 
P P P 

plant  is  W (s)  where 
P 

T -1  a K z (s) 

W (s)  - h (sI-A  ) \ P-  - (2) 

p p p p Rp(s) 


i I . 


with  W (s)  strictly  proper,  Z (s)  a monic  Hurwitz  polynomial  of  degree  m(<n-l) , R (s) 
P P P 

a monic  polynomial  of  degree  n and  K a constant  gain  parameter.  We  further  assume 

P 

that  only  m,n  and  the  sign  of  K are  known  for  use  in  the  design  of  an  adaptive 

P 

* 

controller. n (=n-m)  is  referred  to  as  the  relative  degree  of  the  plant. 

A model  M represents  the  behavior  desired  from  the  plant  when  it  is  augmented 
with  a suitable  controller.  The  model  has  a reference  input  r(t)  which  is  uniformly 
bounded  and  an  output  yw(t) . The  transfer  function  of  the  model,  denoted  by  W (s) 


may  be  represented  as 


W (s)  = 


V8) 


M(S/  " KM  R^s) 


where  Z^Cs)  is  a monic  Hurwitz  polynomial  of  degree  m^  m,  R^(s)  is  a monic  Hurwitz 
polynomial  of  degree  n and  is  a constant.  W^(s)  is  completely  specified  and  the 
aim  of  the  design  is  to  generate  suitable  bounded  inputs  u(t)  to  the  plant  so  that 
the  deviation  of  the  plant  from  the  desired  behavior  as  measured  by  an  error  signal 


e^(t)  where 


tends  to  zero  as  t -►<*>. 


e!(t)  I " IV°  " yM(t) 


t 
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Structure  of  the  Controller  (n  $2) ; 

The  basic  structure  of  the  adaptive  controller  used  In  the  following  sections 
is  shown  in  Figure  1 . The  controller  consists  of  a gain  Cq  and  two  auxiliary 
signal  generators  and  F F^  contains  (n-1)  parameters  c^  (i  * 1,2,..., n-1) 
and  F2  contains  n parameters  d^  (j  = 0,1,2, .. .n-1) . The  2n  adjustable  parameters 
are  denoted  by  the  elements  of  a parameter  vector 

0T(t)  = [cQ(t)eT(t)]  = [c0(t),ci(t),...cnl(t),d0(t),d1(t),...dn_1(t)]  (5) 

F^  and  F2  are  described  by  the  vector  differential  equations 


v<«  - Av«>  + bf„ 

»<»  . CVU 


} 


(6) 


;(2)  - Av(2)  + V S 

f P | 

(2)  „ 4.  jT  (2)  J 

w = d.y  + d v r 

0 P 


T T 

where  A is  an  (n-1)  x (n-1)  stable  matrix,  c = [c  ,c  ,...,c  .]  and  d 

1 / n~-L 

••»dn-ll- 

Defining  the  vector  of  transfer  functions  V(s)  as 


[d^ » d2 » • • 


V(s)  - (sI-A)“V 


(7) 


V^(s),  the  i1"*1  component  of  V(s),  denotes  the  transfer  function  from  u(t)  to  v^^(t) 

(2) 

or  y (t)  to  v (t).  For  constant  values  of  the  control  parameters  the  transfer 
P 1 

functions  of  F^  and  F2  are  W^s)  and  W2(s),  where 

V8)  ' cIv<8)  ‘ Sw  ; w2(8)  ’ dTv<8)  + do  4 5(f)- + do  <8) 


If  (A,b^)  is  in  companion  form,  c^  and  d^  (i  = 1,2,..., n-1)  represent  the  coefficients 

of  8°  1 * of  the  numerator  polynomials  of  W^(s)  and  W^s)  respectively. 

Denoting  the  principal  signals  of  interest  r(t),v^(t),  y (t)  and  v^(t)  as 

P 


the  elements  of  a vector  m(t) 
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mT(t)  - [r(t)  ,u)T(t)  ] = [r(t),v(1)T(t),yp(t),v(2)T(t)]+  (9) 

the  input  to  the  plant,  as  shown  in  Figure  1 is 

u(t)  * 0T(t)co(t)  - ae^(t)(oT(t)r«(t)  T = T*  > 0 (10) 

a > 0 

The  only  difference  between  the  controller  structure  described  in  equations  (5-10) 
and  that  given  in  [2]  is  the  existence  of  the  second  term  in  the  right  hand  side 
of  equation  (10) . 

Following  the  results  of  [2]  it  can  be  shown  that  a constant  control  parameter 

_ mm’fC 

vector  0 exists  such  that  if  0(t)  = 6 the  transfer  function  of  the  plant  together 
with  the  controller  matches  that  of  the  model  exactly.  If  e(t)  represents  the 
state  error  between  model  and  plant,  the  error  differential  equations  are: 


e(t)  * A e(t)  + b [tT(t)u>(t)  - ae  (t)a>T(t) rw(t)  ] 
c c 1 

e(t)  = h Te(t) 

1 c 


(11) 


A T -i 

where  W (s)  = h (sI-A  ) b ■ -f-  W (s)  is  strictly  positive  real,  and 
e c c c M 

4>(t)  = 0(t)  - 9 is  the  parameter  error  vector  [Ref.  equations  (18)  and  (19)  in 
[2]  and  Figure  2],  The  adaptive  laws 


d>  (t)  = -re  (t)u(t) 


(12) 


assure  the  boundedness  of  4>(t)  and  e(t)  and  that  e^(t)  -♦•0  as  t -*■  <»  [Ref.  section 
3 for  proof Since  the  states  of  the  model  are  bounded,  this  also  assures  the 
boundedness  of  the  plant  states. 

t In  equations(5)and(9) the  2n  dimensional  vectors  0(t)  and  w(t)  are  defined. 

In  the  main  discussions  in  the  paper,  as  explained  later,  only  the  2n-l  dimensional 
vectors  0(t)  and  <o(t)  are  used. 

ft  c^(t)  is  the  error  between  plant  and  (unaugmented)  model  outputs.  In  section  3 
e^(t)  is  the  output  error  when  the  model  output  is  augmented.  The  form  of  the 
differential  equations  (11)  and  (12),  however, remains  the  same  in  the  two  cases. 


• 
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For  a relative  degree  n = 2,  the  modification  suggested  in  [2]  can  again  be 

used  in  this  case  also  to  develop  adaptive  control  laws  of  the  form  (12)  [equation 

(22)in  [2]].  The  principal  difficulty, therefore,  arises  when  the  relative  degree 
* 

n is  greater  than  or  equal  to  three.  In  such  a case,  an  auxiliary  signal  corres- 
ponding to  each  control  parameter  has  to  be  used  as  an  input  to  the  model  as 
described  in  [2], 

* 

Structure  of  the  Controller  (n  ^ 3) : 

* 

If  n 2 3,  with  no  loss  of  generality  (Ref.  [2]),  let  L(s)  represent  a Hurwitz 

polynomial  in  ’s'  such  that  W (s)L(s)  is  a strictly  positive  real  transfer  function. 

If  every  parameter  0^(t)  in  the  controller  in  Figure  1 is  replaced  by  an  operator 

p (0  (t))  = L(s)e  (t)L  1(s) , the  same  procedure  as  that  outlined  earlier  can  be  used 
Li  i 

• -1 

to  derive  the  adaptive  laws.  In  such  a case,  0(t)  = -re^(t)C(t) , where  L (s)u)(t)  = 

= C(t) . However,  since  the  controller  is  to  be  differentiator  free,  such  a procedure 
is  not  possible.  Therefore,  the  following  approach  described  in  [2]  is  used.  Corres- 
ponding to  every  feedback  signal  0 (t)<o.  (t)  to  the  plant,  a signal  [0  (t)-P  (0  (t))]co.(t) 

i i 

is  fed  back  into  the  model  to  preserve  the  form  of  the  error  differential  equations 
(11)  and  hence  the  adaptive  laws  (12).  This  results  in  the  structure  of  the  adaptive 
controller  described  later  in  this  section. 

The  complexity  of  the  controller  (as  given  in  [2])  is  also  determined  by  the 
prior  knowledge  of  the  gain  K of  the  plant.  We  therefore  deal  with  the  simpler 

p 

case  first,  when  K is  known,  and  later  consider  the  case  when  K is  unknown.  In 
P P 

section  5,  for  clarity  of  presentation,  the  proof  of  stability  is  also  given  separately 
for  the  two  cases. 

Case  (i)  (K  known):  With  no  loss  of  generality,  we  can  assume  here  that  K = K =1. 
E M P 

This  implies  that  c^  “ 1 and  hence  only  2n-l  control  parameters  (the  elements  of  0(t)) 
need  to  be  adjusted. 

If  the  input  signal  to  the  plant  is 


u(t)  « 0 (t)ui(t)  + r(t) 


— B ••  -da 
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the  plant  output  can  be  expressed  as 

y (t)  * W (s)Ir(t)  + <|>T(t)u)(t)  ] (14) 

p M 

The  model  output  is  augmented  by  the  additional  output  y (t)  where 

a 

y (t)  =W  (s)L(s)[{L  1(s)6(t)-0(t)L  1(s)}Tu)(t)  + ae  (t)CT(t)rs(t)  ] (15) 

a m 1 

and  L 1(s)oj(t)  = C(t)  (Figure  3). 

The  total  output  of  the  model  y(t)  is  the  sum  of  the  desired  output 
y^(t)  = WM(s)r(t)  and  the  augmented  output  y^t);  the  augmented  error  e^(t) 

e (t)  = y (t)  - y(t)  = e (t)  - y„(t)  (16) 

ip  1 a 

is  given  by 

ex(t)  - WM(s)L(8)[^T(t)c(t)  - ae1(t)?T(t)rc(0]  (17) 

which  has  the  same  form  as  (11)  with  u(t)  and  e^(t)  replaced  by  C(t)  and  e^(t) 
respectively. 

The  adaptive  law  for  updating  the  control  parameters  is  now 

♦ (t)  = -rei(tK(t)  (18) 

Case  (ii)  (k  unknown) : While  the  error  equations  appear  to  be  considerably  more 
2 

involved  when  Kp  is  unknown,  they  can  be  readily  reduced  to  the  same  form  as  before 
by  using  a change  of  variables  (as  shown  in  [2]).  The  input  to  the  plant  is  now 
given  by 

u(t)  = 6T(t)m(t)  (19) 

The  main  difficulty  here  is  that  K is  different  from  K and  hence  an  additional 

p M 

parameter  ij>^(t)  bas  to  be  introduced  in  series  with  the  auxiliary  input  to  the 
model  to  obtain  the  error  equations  in  the  form  given  in  (17).  For  each  signal 
0i(t)u)i(t)  fed  back  into  the  plant  a signal  L(s)i|^  (t)  [L  ^(s)0^(t)  - ©^(t)!.  ^(s)]w^(t) 
has  to  be  fed  back  into  the  model  (or  i|i^(t)[L  ^(s)6^(t)  - 0^(t)L  ^(s)]to^(t)  into 


MODEL 


ot£,  (t)rc(t) 
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W (s)L(s)  for  practical  realization).  The  2n+l  parameters  0 (t)  (i  = l,2,..,2n) 
M l 

* 

and  (t)  have  to  be  adaptively  adjusted  so  that  (t)  -►  K /K  and  6,(t)  0 

1 1 p M 1 1 

as  t -*• 

The  augmented  error  e^(t)  and  the  adaptive  laws  are  now  given  by  (Ref.  [2]) 

ei(t)  = ^ rwM(s)L(s)HuT(t)E(t)  + iKt)i(t)] 


(t)rc(t)} 


4>(t)  = -rei(t)c(t) 

«Kt)  * -Ye^(t)£(t) 


where 

£(t)  =L~1(s)m(t);  S(t)  = [L'1(s)^(t)  - $(t)L-1(s) ]Tw(t)  and 

K 

♦ (t>  - 1 - v11  (t)  (22) 

Kp  1 

The  stability  problem  that  arises  is  the  same  whether  is  known  or  unknown  and  is 

stated  in  the  next  section. 

3.  Statement  of  the  Stability  Problem: 

As  shown  in  this  section,  when  the  adaptive  laws  (12),  (18)  or  (19)  are  used 
* * * 

(for  the  cases  n < 2,  n £ 3(K  known) and  n z 3(K  unknown) respectively)  it  is 

P P 

possible  to  demonstrate  through  the  existence  of  a Lyapunov  function  that  the  state 

error  vector  e(t)  or  e(t)  as  well  as  the  parameter  error  vector  <J>(t)  are  bounded. 

•k 

When  n * 2 (and  no  auxiliary  input  to  the  model  is  used) the  output  of  the  model 

y (t)  is  bounded  and  hence  the  boundedness  of  the  plant  output  can  be  concluded. 

M 

k 

This,  in  turn,  results  in  c^(t)  + 0 as  t -v  «.  However,  when  n 5 3 we  cannot 
assume  that  the  model  output  (y(t)  = y (t)  + y (t))  is  bounded  and  this  leads  to 
the  principal  stability  question  of  interest  in  this  paper. 

If  the  input  to  the  plant  u(t)  is  given  by  (13)  (K^  known)  or  (19)  (K^  unknown), 
the  error  model  is  defined  by  (17)  or  (20)  and  the  corresponding  adaptive  laws 


-9- 

are  specified  by  (18)  and  (21),  the  problem  of  stability  is  to  conclude  the  bounded- 
ness of  the  plant  output  y^(t)  and  hence  all  the  relevant  signals  in  the  system. 
Demonstrating  that  this  is  indeed  the  case  is  the  principal  contribution  of  this 
paper.  We  now  proceed  to  state  the  stability  problem  analytically  for  the  case 

when  K is  known. 

P 

The  Error  Model  (K  known) : 

P 

The  differential  equations  describing  the  augmented  error  e(t)  may  be  expressed 
as  (Ref.  [2]) 

e = A e(t)  + bv(t) 
c 

e^(t)  = h^e(t)  (23) 

v(t)  = <f>T(t)C(t)  - aST(t)re(t)e  (t)  a > 0 

where 

hT(sI-A  )_1b  = W (s)L(s)  is  SPR  (24) 

c M 

(compare  with  equation  (17)).  The  corresponding  adaptive  laws  are 

i(t)  = -rei(t)5(t).  (18) 

* 

For  the  case  n < 2,  the  equations  are  the  same  with  4(t)  replaced  by  w(t)  and  the 
boundedness  of  the  plant  output  assures  the  boundedness  of  u>(t)  in  the  corresponding 
error  equations.  A difficulty  arises  in  this  case  since  yp(t)  and  hence  c(t)  can- 
not be  assumed  to  be  bounded. 

By  the  Kalman-Yacubovich  lemma  [141  it  is  known  that  if  condition  (24)  is 

T 

satisfied,  a real  matrix  P = P > 0 , a vector  q,  and  an  e > 0 exist  such  that 

T 

for  any  matrix  N = N >0 

T T 

A„P  + PA  ■ -qq  - eN 
c c 


Pb  = h 


(25) 
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are  simultaneously  satisfied.  Defining  a Lyapunov  function  for  the  set  of 
differential  equations  (23),  (18)  as 

V(e,<(>)  - eT(t)Pe(t)  + <|>T(t) r-1<|>(t) 


we  obtain  using  (25) 

V(e,<(>)  = -eT(t)[qqT  + eN]e(t)  - 2a[ei(tK(t)  l^te^OUt)  ] 
S 0 for  a > 0 


(26) 


It  follows  that  the  error  model  is  uniformly  stable  and  e(t)  (hence,  e^(t))  and  4>(t) 

are  uniformly  bounded  for  any  finite  initial  conditions.  Further,  since  V(t)  is  a 

* 

non- increasing  function  which  is  bounded  below,  it  converges  to  some  limit  V • [For 
n*  c 2 these  conditions  are  adequate  to  assure  that  e(t)  -*■  0 as  t -*■<*>] . By  (26) 
since  V(e,<fi)  is  uniformly  bounded  we  have 

e(t)  , e^tKU)  c L2  (27) 


Since  $(t)  = -re  (t)?(t),  (27)  implies  that 

♦ (t)  e L2 


(28) 


T 

The  importance  of  the  additional  feedback  term  ae^(t)C  (t)rt(t)  in  the  error  model 

• 2 T 

is  now  apparent.  Since  V(e,$)  contains  the  term  -e^  (t)C  (t)rc(t),it  is  now  possible 
. 2 

to  conclude  that  <j>(t)  e L which  is  central  to  the  proof  of  stability. 

The  Plant  Feedback  Loop: 

The  plant  together  with  the  controller  may  be  described  by  the  differential 
equations 


x(t)  = A x(t)  + b [ 4>T( t) o> ( t)  + r(t)  ] 
c m 

u>( t)  = C x(t) 
m 

or  equivalently  by  a vector  transfer  function  W(s)  ■ C (sI-A  ) ^b 

in  c m 


i29) 


WM(S> 

Wp(s) 

V8) 


V(s) 


W (s)V(s) 
n 


. . — . — r . 


(where  V(s)  is  defined  in  (7))  in  the  forward  path  and  a gain  vector  <J>(t)  in  the 
feedback  path.  Further, c(t)  = L 1(s)uj(t)  and  the  plant  feedback  loop  together  with 
the  error  model  may  be  represented  as  shown  in  the  Figure  4 . 

The  Stability  Problem;  is  then  to  show  that  the  plant  feedback  loop  with  <Kt)  ad- 

justed  according  to  the  adaptive  law  (18)  and  $ e L is  stable  in  the  large. 

When  K is  unknown,  the  error  equations  (23)  have  to  be  replaced  by  those 
P 

corresponding  to  (20)  but  the  plant  feedback  loop  remains  essentially  the  same 
(Cg(t)  is  also  adjusted)  (Figure  5).  Hence,  the  nature  of  the  stability  problem  is 
the  same  in  both  cases . 

Stability  Problem  in  the  Discrete  Case:  The  form  of  the  difference  equations 

describing  the  plant,  the  reference  model  and  the  error  model  is  the  same  as  that 

described  in  this  section  but  the  stability  problem  is  considerably  simplified  by 

2 

the  fact  that  A<t(k)  e i and  hence  A<(> ( k)  -*■  0 as  k -*■  00 . V(e(k),<Kk))  > 0 and 

AV(e(k)  , 4> ( k) ) < 0 also  results  in  e(k)  ,e^(k)  .e^k)  c(k)  and  v(k)  + 0 as  k + ». 

Hence,  all  the  results  described  in  section  (5)  carry  over  directly  to  the  discrete 
case  as  well. 

4.  Mathematical  Preliminaries: 

The  proof  of  stability  of  the  adaptive  control  problem  is  discussed  in  section 

5 and  is  based  on  the  five  lemmas  given  in  this  section.  The  definitions  and  related 

mathematical  concepts  needed  for  the  proof  of  the  lemmas  are  developed  in  this  section. 
00  - 

Definition  Is  L denotes  the  space  of  functions  which  are  bounded  for  finite  time, 
e 

i.e. 

L°°  = (f:  R+  R /sup | f (x)  | < co  , for  all  t e R+ } 

6 t*T 

Remark  1:  Since  the  parameter  error  vector  $(t)  is  uniformly  bounded  all  the  sig- 
nals in  this  paper  can  grow  at  most  exponentially  and,  therefore,  belong  to  this 
space. 

Definition  2:  Let  x(t),y(t)  e L • Let  8(t)  be  a continuous  function  such  that 
8(t)  0 as  t -*■  00 . If  y(t)  = 8(t)x(t),  we  denote 


gure 


I 


jyjizjy.'T-jrr 


-12- 


y(t)  = o [x( t) ] 

Remark  2:  (1)  If  y(t)=  o[y(t)],  then  y(t)  0 as  t “. 

(ii)  If  |y(t)|  = o[sup|y(x) |],  then  y(t)  + 0 as  t 00 . 

tit 

(ill)  If  | y( t) | = x(t)  + o[sup|y(T)|]  and  x(t)  is  uniformly  bounded 

t>T 

then 

y(t)  is  also  uniformly  bounded. 

Definition  3:  Let  x(t),y(t)  e 1~.  If  there  exists  a constant  M > 0 such  that 
J y ( t) | £ M|x(t)|,  then  we  denote 

y(t)  = 0[x(t) ] 

Remark  3:  If  the  input  to  a linear  exponentially  stable  system  is  x(t)  e and 
the  corresponding  output  is  y(t),  then 

| y ( t) | = 0[sup|x(x) | ] (30) 

t>T 

In  particular,  the  input  and  output  of  an  asymptotically  stable  linear  time-invariant 
system  satisfy  (30) . 

Definition  4:  Let  x(t),  y(t)  e l”.  If  y(t)  = 0[x(t)]  and  x(t)  = 0[y(t)],  then  we 
say  that  x(t)  and  y(t)  are  equivalent  and  denote  this  by 

x(t)  'v.  y(t) 

Definition  5:  Let  x(t),y(t)  e L° . If  sup|y(x)|  ^ sup|x(x)|,  we  say  that  x(t)  and 

® t*x  t*X 

y(t)  grow  at  the  same  rate. 

Remark  4;  (i)  Two  signals  which  are  equivalent  grow  at  the  same  rate  but  the  con- 

verse is  not  true. 

(ii)  Two  signals  which  are  uniformly  bounded  grow  at  the  same  rate.  Hence  this 

definition  is  of  interest  mainly  for  unbounded  signals. 

(lii)  If  x(t),y(t)  e L*,  only  one  of  the  following  three  conditions  can  hold: 

sup | x(t) | 'V  sup|y(x)|,  sup |y(x) | - o[sup|x(x) | ] , or  sup|x(x) | ■ o[sup|y(x)|] 
t^x  tfcx  t^x  t>x  t>x  t>x 


(sup|x(x)|  = 0[sup| y(x) | ]}. 

t*X  t>X 


(v)  Let  an  n-dimensional  vector  x(t)  e L be  unbounded,  then  there  exists  at 

e 

least  a component  x (t)  such  that 

i0 

I 

sup|x  (t)  I 'V-  supj|x(x)  || 
t*X  X0  t>X 

In  the  following  Lemmas  1-3,  x(t),y(t)  e l”  and  H(s)  is  the  rational  transfer 
function  of  an  asymptotically  stable  system  and  is  strictly  proper.  All  initial 
conditions  are  assumed  to  be  identically  zero.* 

Lemma  1;  Let  x(t)  and  y(t)  be  the  input  and  output  respectively  of  a system  with 

transfer  function  H(s) . Then 

(i)  x(t)  e LP=»  y(t),  y(t)  e LP  1 < P ^ 00 
1 2 

(ii)  x(t)  e L or  L y(t)  + 0 as  t+» 

(iii)  x(t)  + 0 as  t + » * y(t)  + 0 as  t +■ 

The  proof  of  Lemma  1 can  be  found  in  any  good  text  on  linear  systems  (Ref.  [15]). 

2 1 oo 

Lemma  2:  Let  x(t)  e L (or  L ) and  p(t)  e L . If  x(t)p(t)  is  the  input  to  H(s) 

e 

and  y(t)  the  corresponding  output,  then 


y(t)  = o [ sup | p (x ) | ] 
t>x 

Proof : Let  h(t)  be  the  impulse  response  of  H(s) . h(t)  e L^. 

y(t)  = [ h(t-x)x(x)p(T)dT 
J0 

t 

|y(t) | ^ sup | p ( x) | |h(t-x)x(x) |dx 

tiT  Jo 

2 i t 

Since  Lemma  1 is  valid  for  any  x(t)  £ L (or  L ),  jh(t-x)x(x)  |dx  0 as  t •*  <*>  or 

J0 

I y ( t)  | - o [ sup | p (x ) |] 
t*x 

* If  the  initial  conditions  are  non-zero,  the  output  in  Lemma  2 contains  an 
additional  exponentially  decaying  term. 


1 


Lemma  3:  In  the  feedback  system 
shown  in  Figure  6 


y(t)  = H(s) [x(t)+3(t)y(t) ] 


2 i 

If  0 ( t)  e L or  L or  B(t)  -+■  0 as  t -*■  <*>,  then 


(i)  y(t)  ->  0 as  t -*■  <*>,  if  x(t)  + 0 as  t -*■  °° 

(ii)  y(t)  is  uniformly  bounded,  if  x(t)  is  uniformly  bounded. 


Figure  6 


Proof : The  proof  is  a direct  consequence  of  Lemma  2,  the  linearity  of  H and 
Remark  2. 

Remark  5:  If  in  Lemma  3 |x(t) | = o[sup |y(t) | ] , the  same  results  hold  and 

t*T 

x(t),y(t)  -*■  0. 

1 2 

Remark  6:  In  the  discrete  case  x(k)  e £ or  l implies  that  x(k)  + 0 as  k + ®. 

With  obvious  modifications  Lemmas  1-3  hold  even  if  H(z)  is  a proper  (and  not 
strictly  proper)  discrete  asymptotically  stable  transfer  function. 

While  various  generalizations  of  the  following  lemma  can  be  stated, Lemma  4 is 
adequate  for  the  proof  of  stability  in  section  5. 

Lemma  4:  In  the  plant  feedback  loop  (Figure  3)  defined  by  equations  (1)  and  (6), 

the  input  to  the  plant  and  the  states  of  F^  and  F^  can  not  grow  faster  than  the  output 
of  the  plant  i.e. 

u(t),v^(t),v^2)(t)  = 0 [sup  | y (t)|]  i = 1,2,...  ,n-l 
1 1 t>t  p 

Proof:  Since  v^(t)  and  v^2\t)  are  the  states  of  the  asymptotically  stable  sys- 

terns  F,  and  F»  with  inputs  u(t)  and  y (t)  respectively,  we  have  v^  ' (t)  ■ 0[sup|y  (t)|], 
12  P 1 t*r  P 

Hence  it  suffices  to  show  that 


u(t)  = 0 [ sup | y (T) | ] 


We  show  in  what  follows  that 


y (t)  - o[sup |u(t) |] 

*'  t>T 
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- 


il 


4 

Li 


leads  to  a contradiction.  By  (31)  we  have 


vj2)(t)  = 0[8Up|u(T)|] 
t*T 


(32) 


Consider  the  feedback  loop  F defined  by 


= Av^1^  + bfu 


(6) 


and 


u(t)  = 6 (t)u>(t)  + r(t) 


(13) 


.(2), 


(1) 


(t)  , 1 S i 5 n-1  which  grows  at  the  same  rate  as  the  input  u(t)  or 
10  0 


(1) 


SUp  | V^  (T)|  ^ sup  I u(t) 


(33) 


t>T 


t*T 


Since  F^is  a vector  differential  equation  with  bounded  coefficients 


|v(1)(t)|  = 0[sup|v(1)(T)|] 

0 t*t  1o 


(34) 


Since  W^(s)  is  a transfer  function  with  zeros  in  the  open  left  half  plane  and 


Vi2>(t)  = Wn(8)v!1)(t) 
i0  p 10 


(35) 


it  follows  from  (34)  that 


sup  |v(1)(t)|  -0  [sup|v(2)(T)|] 

t>T  t*T  X0 


(36) 


From  (33)  and  (36) 


sup|u(x)|  - 0[sup|v^  (t)  | ] 
t»T  tit  X0 


which  is  a contradiction  to  (32).  Hence 


u(t)  - 0 [ sup | y (x)  | ] 
t*T  P 


which  proves  the  lemma. 


Since  r(t)  is  uniformly  bounded  and  y (t)  and  vv  7(t)  satisfy  (31)  and  (32),  if  u(t) 

P 

is  unbounded,  v^(t)  is  also  unbounded  and  by  Remark  4 there  is  at  least  one  variable 


F 
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Remark  7:  Lemma  4 is  needed  since  we  cannot  directly  conclude  that 

u(t)  = 0[8upiy  (t) | ] . In  the  error  model,  though  e (t)  is  uniformly  bounded, we 
t>r  p 

cannot  conclude  that  v(t)  is  uniformly  bounded  for  the  same  reason.  However,  in 

discrete  systems  it  follows  directly  that  v(k)  + 0 as  k + 

Lemma  5 is  central  to  the  proof  of  stability  in  section  5 and  relates  the 

operator  P ($)  « L 1(s)<f>( t)L(s)  to  the  pure  gain  <j>(t)  [Ref.  equation  (10)  in  [2]]. 

L 

Let  L(s)  be  a Hurwitz  polynomial  in  's'  of  degree  r.  With  no  loss  of  general- 
ity* assume 

r 

L(s)  * n (s+a  ) (37) 

i=l  1 

where  a^  is  real.  Defining  A^(s)  as 

A (s)  = L(s)  / II  (s+a  ),  i = 1,2,  ...r-1;  A (s)  = L(s) 

1 J-l 

if  s(t)  is  a function  which  is  r-times  differentiable,  then 

—1  r_ 1 _i  • 

[L  (s)|(t)L(s)  ]?(t)  = [<Kt)  - l A.  (s)*(t)A  (s)]c(t)  + e(t)  (38) 

i=0  1 11 

where  e(t)  is  an  exponentially  decaying  term  due  to  the  initial  conditions.  Figure 
7 shows  the  two  equivalent  forms  in  (38)  and  the  corresponding  signals. 

Remark  8:  For  the  discrete  cas^  if  L(z)  is  a polynomial  with  all  its  zeros  within 
the  unit  circle 

-1  r_1  -1 

[L  1(z)|(k)L(z)  ] C (k)  = [*(k)  - l A/(z)A*(k)zA  (z)]c(k)  + e(k)  (39) 

i-0  1 1+1 

where  <f>(k+l)  - <Kk)  = A$(k)  and  e(k)  0 geometrically  in  k. 

Lemma  5:  If  L(s)  is  defined  as  in  (37)  and  L(s)((t)  * w(t)  with  u>(t)  e L and 

<|>( t)  e L ni“  then 
e 

[L  1(s)(|)(t)L(8)  ]t(t)  - <|>(t)c(t)  + o[sup|o)(T)  I ] 

t>T 


If  L(s)  contains  complex  conjugate  zeros,  the  form  of  the  expansion  of  the 
operator  L <frL  remains  the  same  but  the  coefficients  of  the  polynomials  have  to  be 
modified.  A.(s)  is,  however,  stable  for  all  i - 0,1, ...r-1,  e.g.,  if 

2.  „ 1 . . . . , . -1..  . s+a  I _ 1 


L(s)  ■ s +2as  + b and  has  complex  zeros  L ♦L  ■ ♦ — —j 


4>  - 


s +2as+b 


s +2as+b 


♦(s+a). 


Figure 
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Proof : The  proof  follows  directly  by  using  the  expansion  (38),  Lemma  2 and  Remark  3 


since 


A (sK(t)  = A (s)L  (s)m(t)  = 0[sup  |o>(t)  | ] 

1 1 t>T 


5.  Proof  of  Stability: 


The  proof  of  stability  of  the  plant  feedback  loop  follows  directly  from  Lemmas 


4 and  5 in  section  4. 


The  motivation  for  the  proof  may  be  described  qualitatively  as  follows:  Assuming 


that  m(t)  and  hence  £(t)  are  unbounded.  Lemma  4 assures  us  that  they  cannot  grow  faster 


than  the  plant  output  y^(t) • Using  Lemma  5>y^(t)  can  be  shown  to  be  the  sum  of  three 


signals,  W (s)r(t) ,e  (t) , and  y (t)  where  the  first  two  are  bounded  and  the  third 
Ml  £ 


term  by  Lemmas  2,3  and  4 is  o[sup|y  (x)  | ] • Hence,  we  have  a contradiction  and  y (t) 

f>T  P P 


is  uniformly  bounded.  This,  in  turn,  implies  that  w(t),£(t)  and  x^(t)  are  uniformly 


bounded . 


Proof: 


Case  (i)  n * 3 and  K = = 1:  (Figure  4) 


By  Lemma  4,  if  we  can  show  that  y^(t)  is  uniformly  bounded,  then  all  signals  in 


the  system  are  uniformly  bounded.  From  (14) 


y (t)  ” W„(s)r(t)  + W (s)<t>  (t)w(t) 

p M M 


where  W (s)r(t)  is  a uniformly  bounded  signal. 
M 


The  second  term  in  the  right  hand  side  of  (40)  can  be  expressed  as 


W (sHT(t)u>(t)  - [WM(s)L(s)][L*1(s)4>T(t)L(s)]c(t) 
M M 


By  Lemma  4 and  Lemma  5 


wM(s)4>T(t)w(t)  * [W  (s)L(s)J{$T(t)c(t)  + o [ sup  | y ( t)  | ] } 
M M t*T  p 


Further,  since  by  (23) 


4>T(t) c(t)  - v(t)  - a;T(t)C(t) 


j 
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where  [Wm(8)L(s) ]v(t)  = e^.t) 


* T • * 

and  [W  (s)L(s)](ot<|>  ( t) C ( t) ) = o[sup|y  vt)  | ] by  Lemma  3,4  and  <P(t)  e L‘ 


M 

Hence,  we  have 


t*T 


y (t)  = W (s)r(t)  + e (t)  + o[sup|y  (t)|] 
P M -I-  P 


t*T 


It  follows  that  y (t)  is  uniformly  bounded  and  the  plant  feedback  loop  is 
P 

the  large. 

* 

Case  (ii)  n > 3 and  K is  unknown:  (Figure  5) 

2 

In  this  case. 


K K _T  _ 

y (t)  = [ ^ W (s)  ][  ^ r(t)  + <p  (t)co(t)  ] 
P Si  M Kp 


= W (s)r(t)  + [ -■£  W (s)L(s)  ] [L  1(s) <f)T( t)L(s)  (t) 

M ‘Sf  M 


By  the  same  arguments  as  case  (i) 


K _T  K 


W„(s)^i(t)co(t)  = [ W (s)L(s)]{<|)T(t)c(t)  +o[sup|y  (t)  | ] > 


M 

From  Figure  5 


^ M 


t^T 


?T(t)C(t)  = v(t)  - a4>T(t)C(t)  - <Kt)5(t) 


But  lit)  = [L_1(s)^T(t)  - ifrT(t)L  1(s)]m(t) 
= L 1(s)^T(t)L(s)?(t)  - ^T(t)?(t) 


o[sup|y  (t) | ] 
t>T  P 


Since  i|i(t)  is  uniformly  bounded,  again  we  conclude  that  y (t)  is  uniformly 

P 

Case  (iii)  discrete  system: 

For  the  discrete  system,  with  v(t)  replaced  by  v(k)  ->■  0 and  A<J>(k)  -*■  0 


stable  in 


bounded . 


, by  eq.  (39) 


stability  follows  trivially. 


» 


LA 
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We  have  established  that  w(t)  is  uniformly  bounded,  hence  the  input  to  the 
error  model  c(t)  is  also  uniformly  bounded.  It  follows  by  (26)  that  e(t)  is 
uniformly  bounded,  hence  the  second  derivative  of  the  Lyapunov  function  V(t)  is 
also  uniformly  bounded,  which  assures  that  V(t)  is  uniformly  continuous.  Hence 


lim  V(t)  = lim  e(t)  = lim  ij>(t)  =0 
t^00  t-X® 


-1  T . T -1 

We  also  notice  that  the  augmented  input  signal  to  the  model  [L  (s)<|>  (t)-<j>  (t)L  (s)  ]w(t) 


and  ae^(t)£  (t)r^(t)  also  tend  to  zero  as  t ■+  <*>.  Hence,  the  error 


e (t)  = y (t)  - y (t)  -►  0 as  t 
1 p M 


5.  Conclusion:  The  paper  presents  a complete  and  unified  proof  of  the  stability  in 
the  large  of  both  continuous  and  discrete  adaptive  control  systems.  Except  for  an 
additional  term,  the  controller  structure  is  identical  to  that  given  in  [2].  When 


the  specified  model  transfer  function  W (s)  is  not  positive  real,  an  operator 

M 


-l. 


P (9)  = L(s) 0 (t)L  (s)  was  used  in  [2]  to  generate  a stable  adaptive  law  for  a 

L 


parameter  0(t) . Almost  all  the  stability  questions  that  arise  in  the  adaptive  control 


problem  can  be  traced  to  this  operator  as  well  as  a related  operator  P (0) 

la 


-1 


L (s)0(t)L(s)  and  the  extent  to  which  these  approximate  a pure  gain  0(t) . In- 


tuition suggests  that  when  0(t)  is  constrained  to  vary  "slowly"  in  some  sense 

2. 


(e.g.  0(t)  + 0 or  0(t)  e L ) the  operator  PL(0)  would  approximate  0(t).  The  proof 
given  in  section  5 may  be  considered  to  be  a mathematical  justification  of  this 
statement.  In  this  sense,  it  is  based  on  our  intuition  regarding  the  behavior  of 
the  adaptive  loop  and  the  augmented  inputs  which  originally  led  to  the  schemes 
suggested  in  [1]  and  [2]. 
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